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Abstract — This paper presents a new adaptive algoritlim for 
the linearly constrained minimum variance (LCMV) beamformer 
design. We incorporate the set-membership filtering (SMF) mech- 
anism into the reduced-rank joint iterative optimization (JIO) 
scheme to develop a constrained recursive least squares (RLS) 

' based algorithm called JIO-SM-RLS. The proposed algorithm 
inherits the positive features of reduced-rank signal processing 
techniques to enhance the output performance, and utilizes the 
data-selective updates (around 10 15%) of the SMF methodology 
to save the computational cost significantly. An effective time- 
varying bound is imposed on the array output as a constraint to 
circumvent the risk of overbounding or underbounding, and to 
update the parameters for beamforming. The updated parame- 
ters construct a set of solutions (a membership set) that satisfy the 
constraints of the LCMV beamformer. Simulations are performed 
to show the superior performance of the proposed algorithm in 

1 terms of the convergence rate and the reduced computational 
complexity in comparison with the existing methods. 

I. Introduction 

I Beamforming is an important antenna array technique with 

■ application in wireless communications to adjust array pa- 
'rameters for maintaining the array response from a certain 

direction while attenuating interference and noise. The optimal 
' linearly constrained minimum variance (LCMV) beamformer 
[IT) is a well-known beamforming technique. Many adaptive 
filtering algorithms have been proposed for the implementation 

■ of the LCMV beamformer, ranging from the low-complexity 
' stochastic gradient (SG) algorithm to the more complex recur- 
sive least squares (RLS) algorithm [2 1. The major drawback of 

' the reported algorithms is that they require a large number of 
. samples to reach the steady-state when the number of elements 
in the filter is large. Besides, filters with many elements always 
. show a poor performance under dynamic scenarios for tracking 

■ signals embedded in interference and noise. 

An effective approach to circumvent these shortcomings is 
to utilize reduced-rank array processing and adaptive filtering 
techniques for the beamformer design. The reduced-rank array 
processing techniques aim to construct a projection matrix 
to project the array input vector onto a lower dimensional 
subspace, and use a reduced-rank adaptive filter to perform 
the weight update within this subspace. Compared with the 
full-rank techniques, the reduced-rank one achieves fast con- 
vergence and improved tracking performance since the number 
of elements in the reduced-rank filter is much less than those 
in the full-rank filters, especially under the condition where 
the number of sensor elements in the array is large. The 



popular reduced-rank schemes include the auxiliary vector 
filtering (AVF) |3|, the multistage Wiener filter (MSWF) 
[4 1, and the joint iterative optimization (JIO) l5j|, [TJ. The 
SG and RLS type algorithms are developed based on the 
reduced-rank schemes for implementation. Despite the im- 
proved convergence and tracking performance achieved with 
these reduced-rank adaptive algorithms, the calculation of the 
projection matrix and the reduced-rank weight vector requires 
a significant computational cost. 

The contribution of this paper is the development of a 
new adaptive filtering algorithm for the beamformer design 
that guarantees the improved convergence and tracking per- 
formance compared with those of the existing fuU-rank and 
reduced-rank algorithms, whereas the computational cost is 
much lower than that of its reduced-rank counterparts. An 
efficient approach to reduce the computational cost is to em- 
ploy a set-membership (SM) technique to adaptive filtering |9|, 
[101. The SM technique specifies a bound on the magnitude 
of the estimation error (or the array output) and uses the 
data-selective updates to encompass a set of parameters in a 
feasibility set, in which any member is a valid SM filter that 
satisfies the constraints of the design criterion. It involves two 
steps: 1) information evaluation and 2) parameter adaptation. 
If the parameter update does not occur frequently, and the 
information evaluation does not involve much complexity, the 
overall computational cost can be saved substantially. The 
well-known SM based algorithms include the works reported 
in lfT0l - lfT2l . which were developed for the full-rank parameter 
estimation. In this paper, we introduce the SM technique into 
reduced-rank array processing and propose a novel reduced- 
rank adaptive algorithm. The proposed algorithm introduces a 
framework to combine the SM mechanism with the reduced- 
rank joint iterative optimization (JIO) scheme |7|, and devel- 
ops a RLS algorithm for implementation, which is termed 
JIO-SM-RLS. An effective time varying bound is employed 
in the proposed algorithm as a constraint to avoid the risk 
of overbounding or underbounding llT2l . Compared with the 
existing algorithms, the JIO-SM-RLS algorithm inherits the 
positive features of the JIO scheme to enhance the conver- 
gence and tracking performance, and utilizes the data-selective 
updates of the SM mechanism to save the computational cost 
significantly. 

The remaining of this paper is organized as follows: we 
outline a system model for beamforming and present the 



reduced-rank technique in Section II. Section III introduces the 
reduced-rank SM scheme and Section IV derives the proposed 
JIO-SM-RLS algorithm. Simulation results are provided and 
discussed in Section V, and conclusions are drawn in Section 
VI. 

II. System Model and Reduced-rank 
Beamformer Design 

A. System Model 

Let us suppose that q narrowband signals impinge on a 
uniform linear array (ULA) of m (q < m) sensor elements. 
The sources are assumed to be in the far field with directions of 
arrival (DOAs) 6*0,. . . ,6'g-i. The received vector x{i) e C™^^ 
at the ith snapshot can be modeled as 

x{i) = A{e)s{i) + n{i), i = l,...,N (1) 

where 9 = [9a, . . . ,9g^if e W""^ is the DOAs, A(6») = 
[a{9{)), . . . ,a{9q-i)] G C™^^ composes the steering vec- 
tors a{9k) = [i,e-2-.'"£^-«^,...,e-2-j("~^)^"°^''^]^ G 
Qrnxi ^ (fc = 0, ...,(7 — 1), where Ac is the wavelength 
and d = Ac/2 is the inter-element distance of the ULA, and 
to avoid mathematical ambiguities, the steering vectors a{9k) 
are considered to be linearly independent, s{i) G C^^^ is the 
source data, n{i) G C™^^ is the white Gaussian noise, N 
is the observation size of snapshots, and (■)^ stands for the 
transpose. The output of a narrowband beamformer is 

= w"x{i), (2) 

where w — [wi, . . . , w™]^ G C™^^ is the complex weight 
vector of the adaptive filter, and (•)^ stands for the Hermitian 
transpose. 

B. Reduced-rank Beamformer Design 

For large m or in the dynamic scenario, the full-rank 
adaptive algorithms (e.g., SG or RLS) fail or provide poor 
performance with a small number of snapshots for the beam- 
former design. Many of recent works in the literature have 
been reported based on the reduced-rank techniques to solve 
these problems fSj-IISl. The important feature of the reduced- 
rank schemes is to construct a projection matrix — 
[ti, . . . ,tr\ G C™^'' with columns ti = 1, . . . , r) constitute 
a bank of r full-rank filters as given by ti = [ti^u ■ ■ ■ , tm.i]'^ £ 
^mxi jjjg projection matrix performs the dimensionality 
reduction to project the full-rank received- vector onto a lower 
dimension and retains the key information of the original 
signal in a reduced-rank received vector, which is 

x{i) = T"x{i), (3) 

where x G C"^^ denotes the reduced-rank received vector 
and r (1 < r < to) is the rank number In what follows, all 
r-dimensional quantities are denoted by an over bar. 

The reduced-rank adaptive filter w — [wi , . . . , Wr] follows 
the projection matrix to produce the filter output 



y{i)^w"x{i). (4) 

The popular reduced-rank schemes include the AVF ["31, the 
MSWF 1 4 1, and the JIO [7|, which employ the SG or the RLS 
type algorithms to calculate and w for the beamformer 
design. However, with respect to the SG type algorithms, 
it is difficult to predetermine the step size values to make 
a tradeoff between fast convergence and misadjustment in 
dynamic scenarios. Furthermore, the computational cost is 
high due to the calculation of the projection matrix. 

III. Proposed Reduced-rank SM Scheme 

In this section, we introduce a novel reduced-rank SM 
scheme by combining the SM mechanism with the reduced- 
rank JIO scheme. It should be remarked that the JIO scheme is 
considered here since it exhibits the superior convergence and 
tracking performance with relatively simple realization over 
other reduced-rank schemes [7 |. 

The existing SM techniques focus on full-rank signal pro- 
cessing, namely, the related filter w is encompassed in a 
feasibility set, in which any member satisfies a predetermined 
or time-varying bound on the magnitude of the estimation error 
(or the array output). The SM algorithms utilize the data- 
selective updates to reduce computational complexity fT2l. 
Regarding the proposed reduced-rank SM scheme, some valid 
pairs of {Tr,w} are consistent with the bound at each time 
instant due to the joint iterative exchange of information. The 
solution to the proposed scheme is a feasibility set in the 
parameter space, which is 

(so{«)>^(i))eS 

(5) 

where so(i) is the transmitted data of the desired user from 
(?o and S is the set of all possible data pairs (so(«), a;(i)). The 
pairs of {T^, w} m the set are upper bounded in magnitude by 
a time-varying bound 5{i) that can be viewed as a constrained 
condition in the beamformer design. Actually, S cannot be 
traversed all over in practice. An alternative way is to construct 
an exact membership set which is the intersection of 

the constraint sets provided by the observations over the time 
instants i = 1, . . . , iV, i.e., ^1^(1) = Cfi^^hLi with the constraint 
set Ui = {w e r''^,Tr G C"^'' : \y{i)\^ < S'^{i)}. It is 
clear that a larger space of the data pairs leads to a smaller 
membership set. Note that the feasibility set G(i) is a subset 
of the exact membership set ^(i). The two sets will be equal 
if the data pairs traverse S completely. 

IV. Proposed JIO-SM-RLS Algorithm 

In this section, we employ the proposed reduced-rank SM 
scheme to develop a new RLS algorithm. The objective is 
to design a bank of full-rank filters and a reduced-rank filter 
whose output is not greater than a time-varying bound but 
remains the signal from one certain direction for all input data. 
It can be derived by minimizing the following cost function 



minimize E[\w"T^ x{i)\'^] 

subject to w^diOo) = 7, and \w"Tfx{i)\^ = g'^{i), 

(6) 

where 0(6*0) and a{9o) are the full-rank and the reduced-rank 
steering vectors of the desired signal, 7 is a constant with 
respect to the constraint, x{i) = T^x{i) is the reduced-rank 
received vector, and g{i) corresponds to a bound within the 
constraint set Hi with \g{i)\ < S{i). The solutions {Tr,w} 
construct the feasibility set in (|5]l and satisfy the constraints 
in (|6]l. 

The constrained cost function can be transferred into an 
unconstrained least squares (LS) cost function by using the 
method of Lagrange multipliers IZj, which is 



(12) 



w{i) = - X2[[Y,Xr\i)x{l)x"{l) + Xi{i)x{i - l)x"{i - 1)] 

+ Xi{i)x{i)x" {i)y^ a{eo) 
^ -X2R'\i)a{eo), 

(8) 

where R{i) R{i - 1) + Xi{i)x{i)x" (i). It should be 
remarked that the second expression of (|8) is obtained under 
an assumption that Ai(i) — s> 1, which is in accordance with 
the setting of the forgetting factor |2|. 

By substituting ([8]l into the first constraint in ^ and 
employing the matrix inversion lemma (|2 to solve A2, we 
get 



w{i) 



7P(i)a(0o) 



(9) 



(10) 



where P{i) — R ^(i) is calculated in a recursive form 

^ P{i-l)x{t) 

1 + Xi{i)x"ii)Pii-l)x{i) 

P{t) = P{i - 1) - Xi{i)k{i - l)x"{i)P{i - 1). (11) 

Taking the gradient of Tr{i) with respect to (|7]i, making it 
equal to a zero matrix, and consider the assumption Ai (i) 1, 
we obtain 



where ^ R{i-l) + Xi{i)x{i)x" {i).lf y/e define /(i) = 
R^^ {i)a(6o), the solution of Tr{i) in (fT2l i can be regarded 
to find the solution to the linear equation Tr{i)w{i) — f{i). 
Given a w{i) ^ 0, there exists multiple T,.(i) in general. We 
derive the minimum Frobenius-norm solution for stability. The 
details of this derivation can be found in ifTSl . The projection 
matrix can be expressed by 



Tr{i) ^ ~X2R~\i)a{eo) 



(13) 
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The Lagrange multiplier A2 can be solved by substituting 
(flJl i into the constraint {i)T^ {i)a{9i^) — 7. After several 
rearrangements, the resultant projection matrix becomes 



Jls = Y,}^^-'(i)w''(i)T'^{i)x{l)x"{l)Tr{i)w{i) 
1=1 

+ Ai(*) [\w"{^)Tfi^)x{^)\^ - g'{t)] + A2 [w"i^)d{0o) ~ 7] , 

(7) 

where Ai(i) plays the role of the forgetting factor and La- 
grange multiplier with respect to the constraint on the am- 
plitude of the array output, and A2 denotes another Lagrange 
multiplier for the constraint on the steering vector 

It is clear that (|7]i is a function of the projection matrix 
Tr{i) and the reduced-rank filter w{i). Taking the gradient of 
w{i) with respect to Q and making it equal to a null vector, 
we have 



Tr{l) = 



jP{i)ai0o) w"ii) 
afi(9o)P{t)a{9o) \\w{tW 



where P{i) = R ^{i) is calculated by 



P{i - l)x{i) 



(14) 



(15) 



1 + Xi{i)x" {i)P{i - l)x{i) 

P{i) = P{i - 1) - Xi{i)k{i)x"{i)P{i - 1). (16) 

The coefficient Xi{i) is important to the updates of the 
projection matrix Tr{i) and the reduced-rank filter w{i). 
It guarantees an effective exchange of information between 
Tr{i) and w{i), and keeps the constraint on the amplitude of 
the array output upper bounding a specific value following the 
time instant. We utilize the proposed reduced-rank SM scheme 
to compute Xi{i) and perform data-selective updates to adjust 
pairs of {Tr{i),w{i)} with low complexity. Specifically, 
substituting the expressions of (|9]i and (fl4l i into the second 
constraint in ^ and making a rearrangement, yields, 

Ai(z) = 



a"(eo)P{i-l)lS(i)a{eo)-y^x{i)] 
aft {eo)k(i)x" {i)P(i~l)lS{i)a{0a)-'(^x(i)] 





if \y{i)\^>S^{i) 
otherwise, 

(17) 

where k{i) has been given in flSi . The coefficient Ai(z) 
is calculated only if the constraint \w-^ {i)x{i)\'^ — g'^{i) 
cannot be satisfied, so as the updates of Tr{i) and w{i). 
It provides the data-selective updates for the full-rank and 
reduced-rank filters' design, reduces the computational com- 
plexity significantly, and encompasses pairs of {Tr{i),w{i)} 
in the feasibility set 8(«) proposed in Section 3. 

In ( [TT] ). Ai(i) is sensitive to the selection of the time- 
varying bound S{i), which impacts the update rate and the 
tracking performance of the proposed algorithm. We describe 
a parameter dependent bound (PDB) that is similar to the 
work reported in |9 |, and considers the evolution of the full- 
rank weight vector w{i) = Tr{i)w{i) to make the proposed 
algorithm work effectively. The proposed time-varying bound 



TABLE I 

THE PROPOSED JIO-SM-RLS ALGORITHM 



Initialization: 



Tr(0) — [Irxr Orx(m — r)] 

w{0) = (0)a(eo)/(||Tf (0)a(6(o) 

P(0) = plmxm 

P{0) = girxr 



For each time instant i = 1, . 
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S{i) = pS{i - 1) + (1 - p)^a\\Trii)w{i) 



(18) 



where /3 is a forgetting factor that should be set to guarantee 
an appropriate time-averaged estimate of the evolution of the 
weight vector w{i), a (a > 1) is a tuning coefficient, (T^(i) 
is an estimate of the noise power, and \\Tr{i)w{i)\\'^(Tf^{i) is 
the variance of the inner product of the weight vector with the 
noise term n{i) that provides information on the evolution of 
w{i). The proposed time-varying bound provides a smoother 
evolution of the weight vector trajectory and thus avoids too 
high or low values of the squared norm of the weight vector 
A summary of the proposed JIO-SM-RLS algorithm is 
given in Table m where p and g are small positive values for 
regularization, and Tr{0) and w{0) are given to ensure the 
constrained condition. It is clear that the projection matrix 
and the reduced-rank filter exchange information and rely 
on each other, which leads to an improved convergence and 
tracking performance for the proposed algorithm. The pro- 
posed reduced-rank SM scheme with the time-varying bound 
is employed in the devised algorithm to update the pairs of 
{Tr{i),'w{i)} only when the constraint on the array output 
power cannot be satisfied, which results in substantial savings 
in computation that is much less than that of its conventional 
counterparts. 

V. Simulation Results 

In this section, we evaluate the output signal-to-interference 
plus-noise ratio (SINR) performance of the proposed JIO-SM- 
RLS algorithm and compare it with the existing methods, 
including the full-rank (FR) SG and RLS type algorithms 
with or without SM techniques 111, llT2l . and reduced-rank 



algorithms based on the AVF Jl], the MSWF JD, and the JIO 
[7| schemes. We assume that the DOA of the desired user 
is known by the receiver In each experiment, we consider 
BPSK signals and set input SNR= 10 dB and INR= 30 
dB with white Gaussian noise. Simulations are carried out 
with a ULA containing to = 64 sensor elements with half- 
wavelength interelement spacing. A total of K = 1000 runs 
are performed to obtain each curves. 

In the first experiment, q = 25 users, including one desired 
user, exist in the system. The related coefficients for the 
proposed algorithm are set 7 = 1, r = 5, a = 26, /3 = 0.992, 
p = 1.3 X lO^'^, and g = l.O x 10^'^. It should be remarked 
that Ai(i) should be in accordance with the setting of the 
forgetting factor, which is a small positive value less than 1. 
In simulations, we limit its range 0.1 < Ai(i) < 0.998 for 
implementation. In Fig. 1, the curve of the proposed JIO-SM- 
RLS algorithm achieves superior convergence compared with 
existing ones. The steady-state performance of the proposed 
algorithm is quite close to that of the minimum variance dis- 
tortionless response (MVDR) that assumes the knowledge of 
the covariance matrix R [2J. Although the JIO-RLS algorithm 
I?] also enjoys relatively good performance, it requires 100% 
updates (1000 updates for 1000 snapshots) for the filter design, 
which is quite higher than that of the proposed algorithm with 
only 14.2% updates for the pairs of {Tr{i),'w{i)}. 
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Fig. 1. Output SINR versus the number of snapshots 

The next simulation includes two experiments, which com- 
pare the proposed and existing algorithms with the time- 
varying and fixed bounds, respectively. The scenario is the 
same as that in Fig. 1. Fig. 2 (a) shows the results for the 
full-rank algorithms. We find that the FR-SM-RLS algorithm 
converges quickly to the steady-state with relatively low update 
rate (t 20.5%). Due to the BPSK modulation scheme, it 
implies that the algorithm with the fixed bound (5=1.0 should 
achieve a good performance. However, it requires more up- 
dates (r = 61.4%) and thus increases the computational cost. 
The curves with higher (S = 1.4) or lower (S — 0.8) bounds 
exhibit worse convergence performance. The same result can 



be found in Fig. 2 (b) for the reduced-rank algorithms. The 
proposed algorithm with the time-varying bound uses even less 
updates to reahze a high output SINR performance. 




Number of Snapshots Number of Snapsfiots 

Fig. 2. Output SINR versus the number of snapshots for (a) full-rank SM 
algorithms; (b) reduced-rank SM algorithms 



VI. Conclusion 

We have introduced a new reduced-rank SM scheme and 
develop a RLS algorithm for implementation. The proposed 
scheme incorporates the SM mechanism with the time-varying 
bound into the reduced-rank JIO scheme to realize the data- 
selective updates of the full-rank and reduced-rank filters. The 
time-varying bound is combined in the LCMV optimization 
problem as a new constraint on the array output power to 
encompass the pairs of {Tr{i), 'w{i)} in the feasibility set of 
the proposed scheme. A RLS algorithm has been derived for 
implementation. The proposed algorithm achieves an improved 
performance with exchange of information between the projec- 
tion matrix and the reduced-rank weight vector, reducing the 
computational cost primarily with the data-selective updates. 
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